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This research focuses on inservice science teachers' conceptions of nature of science 
(NOS) before and after a two-week intensive summer professional development (PD). 
The PD combined traditional explicit NOS instruction, numerous interactive 
interventions that highlighted NOS aspects, along with documentary films that 
portrayed NOS in context of authentic scientific discovery. Reflective dialogue was used 
throughout the professional development to encourage constructivist learning. The PD 
addressed seven commonly held NOS tenets that are deemed significant to K-12 science 
teachers. Finally, qualitative methodologies were used to analyze the Views of Nature of 
Science Questionnaire (VNOS-D) and the associated interview data to explore subtleties 
within each NOS tenet and to gain a richer understanding of how the teachers' NOS 
understanding differed before and after the PD. 

Keywords : nature of science, professional development, contextualized instruction 

INTRODUCTION 

Understanding nature of science (NOS) is considered a critical component of 
scientific literacy (National Science Teachers Association [NSTA], 1982) and is 
highlighted as a necessary component to science education by the National Science 
Education Standards (National Research Council [NRC], 1996), the Benchmarks for 
Science Literacy (American Association for the Advancement of Science [AAAS], 
1993), and the new Framework for K-12 Science Education (NRC, 2012). Acquisition 
of NOS understanding serves several critical functions for students; it: (a) allows 
them to become educated users of technological and scientific advances in their 
society (a utilitarian function), (b) empowers them to make informed choices about 
social and cultural issues (a democratic function), (c) enables them to appreciate the 
role of science in their own and others' cultures (a cultural function), (d) gives them 
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insight into the moral code of their society which is exemplified in the norms and 
values of the scientific community (a moral function), and (e) increases their ability 
to acquire and retain science content material (an academic function) (Driver, Leach, 
Millar, & Scott, 1996). When teachers lack an understanding of NOS, they lack 
scientific literacy, and by extension, lack the ability to guide their students toward 
scientific literacy. Further, without knowing the basic characteristics of the scientific 
endeavor, teachers lack the ability to determine what materials should and should 
not be incorporated in their curriculum. This deficiency is most notable when 
teachers allow the inclusion of alternative explanations for evolution or 
moral/ethical discussions of controversial topics such as stem cell research and 
cloning to be presented as science knowledge, or alternatively, when they altogether 
exclude topics such as these because they fear the moral and ethical discussions they 
might generate (Bloom &Weinburgh, 2007). 

For over 50 years, research has determined that science teachers lack a 
sophisticated understanding of the philosophical NOS (Anderson, 1950; Barufaldi, 
Bethel, & Lamb, 1977; Behnke, 1950; Billeh & Hasan, 1975; Bloom, Sawey, Holden, & 
Weinburgh, 2009; Bloom & Weinburgh, 2007; Carey & Strauss, 1968; Gruber, 1963; 
Klopfer & Cooley, 1963; Miller, 1963; Riley, 1979; Scharmann & Harris, 1992; 
Trembath, 1972; Welch & Walberg, 1967-1968). This may, in part, be due to the lack 
of clear representation of NOS in curricular materials and/or a lack of NOS 
instruction to preservice science teachers. While the reform documents (AAAS, 
1993; NRC, 1996, 2012) include NOS as an important component to scientific 
literacy, none of these documents provides a clear and concise definition that is 
useful to teachers in gaining a personal understanding of this facet of science for 
themselves, much less in providing authentic NOS instruction to their pupils. Rather, 
the characteristics of NOS are spread across chapters in the science textbooks as if 
these ideas will somehow coalesce into a larger abstraction that can be adopted by 
the reader. Although these documents generally emphasize the same major 
characteristics that define NOS, the views held by scientists, science teachers, and 
philosophers of science fail to achieve this same level of agreement. 

Nature of science can be considered an epistemology of science, one way of 
knowing, and inherent in the development of scientific knowledge (Lederman, 
2007). However, all researchers and philosophers have not accepted this definition. 
For example, Alters (1997) found disagreement among the philosophers of science 
as to what tenets best describe NOS. He further found differences among the views 
of science teachers and scientists. His ultimate appraisal of the situation was, 
"...there is no one agreed-on philosophical position underpinning the existing NOS in 
science education" (p. 48). While characteristics of NOS might be widely debated 
among and between philosophers, teachers, and practitioners of science, many 
researchers in science education argue that agreement does exist (Smith, Lederman, 
Bell, McComas, & Clough, 1997; Smith & Scharmann, 1999) and that the differences 
that exist are not relevant to K-12 science teachers (Lederman, 2007). Seven tenets 
of NOS, commonly held by philosophers, educators, and practitioners of science, are 
considered important for K-12 science teachers and are identified by leading 
researchers in NOS (Bell, Blair, Crawford, & Lederman, 2003; Lederman, Abd-El- 
Khalick, Bell, & Schwartz, 2002; Smith et al., 1997; Smith & Scharmann, 1999). These 
tenets emphasize that scientific knowledge is: 

• tentative; 

• based on empirical evidence; 

• subjective and theory-laden; 

• advanced through creativity and imagination of scientists; 

• socially and culturally embedded; 

• driven by observations and inferences; and 
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• based on laws and theories. 

Bringing NOS learning opportunities into preservice programs has been 
challenging and several models of introducing NOS instruction have been met with 
varying success (Abd-El-Khalick, & Lederman, 2000; Akerson & Hanuscin, 2007; 
Bell, Matkins, & Gansneder, 2011; Clough, 2006; Ozgelen, Hanuscin, & Yilmaz-Tuzun, 
2013; Smith & Scharmann, 2008). Arguably the most widely used model for NOS 
instruction is the explicit-reflective approach (Abd-El-Khalick & Lederman, 2000; 
Lederman & Lederman, 2014). Traditionally, this type of instruction has been 
decontextualized, meaning that NOS is the primary focus of the instruction with no 
direct connection to science content. Despite the wide support for the explicit- 
reflective decontextualized approach, there is concern over the lack of context when 
NOS is taught (Brickhouse, Dagher, Letts, & Shipman, 2000; Olson & Clough, 2001; 
Ryder, Leach, & Driver, 1999; Smith & Scharmann, 1999). Clough (2006) argues that 
only using explicit-reflective decontextualized NOS instruction could lead teachers 
to view NOS as simply an "add-on" and in turn, they may decide to not take 
instructional time away from the rest of their curriculum. 

Another approach is contextualized NOS instruction. In this type of instruction, 
NOS is integrated within specific science content (Bell et al., 2011; Clough, 2006). 
Fewer investigations have explored the effectiveness of contextualized instruction 
that is integrated with specific science content (Bell et al., 2011; Clough, 2006; 
Khishfe & Lederman, 2006, 2007; Matkins & Bell, 2007). Some results have shown 
that contextualized NOS instruction improves both NOS understandings and the 
content specific understandings (Matkins & Bell, 2007). Others found that NOS 
understandings improved regardless of whether the instruction was 
decontextualized or contextualized (Bell et al., 2011; Khishfe & Lederman, 2007). 
Nevertheless, incorporating instruction that has a mix of the decontextualized and 
contextualized approaches appears to be an effective strategy for improving NOS 
understandings as well as one’s ability to apply these understandings to different 
contexts (Abd-El-Khalick, 2001; Brickhouse et al., 2000; Clough, 2006). 

Egan (1997) emphasizes the historical role that visual imagery and storytelling 
has in the transmission of knowledge from generation to generation and indicates 
that content, embedded in stories, is a natural way for humans to develop new 
knowledge. The modern day storytelling is done in front of screens and television. 
Films can be an effective vehicle for teaching content, including science (Dubeck, 
Moshier, & Boss, 1988; Dubeck, Moshier, Bruce, & Boss, 1993; Koehler, Bloom, & 
Binns, 2013). Dhingra (2003) studied the effects of various types of television 
programs on students’ understanding of NOS and found that students were more 
likely to accept scientific conclusions as absolute (not tentative) when presented in 
documentary format. 

This study focuses on these seven specific NOS tenets with the primary objective 
of determining in what ways inservice science teachers’ conceptions of NOS can 
improve through explicit NOS instruction using a variety of contextualized and 
decontextualized strategies. Specifically, eleven science teachers’ conceptions of NOS 
were examined before and after engaging in an explicit, intensive professional 
development (PD), which included traditional decontextualized instruction as well 
as contextualized documentary films to teach about NOS tenets. The research 
question addressed by this study is: 

How does a professional development experience, involving traditional NOS 
instruction (decontextualized) accompanied with documentary films 
(contextualized), effect inservice science teachers’ conceptions of NOS? 

Context of study 
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This research focused on seven major characteristics of NOS deemed important 
to K-12 science instruction (Bell et al., 2003; Lederman et al., 2002; Smith et al., 
1997; Smith & Scharmann, 1999]. While more characteristics of NOS have been 
emphasized (NGSS Lead States, 2013), such new conceptualizations of science relate 
more to the practice of scientists and less to the overarching goal of the PD 
described herein: discriminating between science and non-science. A common 
concern, often expressed by practicing teachers who regularly attend the PD 
experiences provided by the authors, relates to their uncertainty about teaching 
evolution, intelligent design, and/or creationism in the classroom: a general concern 
with teachers throughout the southern United States (Berkman, Pacheco, & Plutzer, 
2008). The seven traditional NOS tenets targeted by this PD were selected 
specifically because they are critical to discerning science from non-science. All 
study participants were practicing science teachers seeking novel pedagogical 
methods as part of their continued PD. NOS instruction via documentary films and 
NOS-focused activities was delivered using an explicit approach combined with 
reflective group dialogue as recommended by current and past research (Abd-El- 
Khalick & Lederman, 2000; Akindehin, 1988; Billeh & Hasan, 1975; Lavach, 1969; 
Smith & Scharmann, 2008). Verbal and written data were analyzed using qualitative 
research methodologies in order to describe the ways in which the participants’ 
conceptions of NOS aligned with or deviated from the presentation of NOS in this PD 
experience. 

The two-week PD experience was offered at a small private university in North 
Central Texas as a part of a yearlong Teacher Quality Enhancement grant program. 
The intention of the two-week summer portion of the PD was to use contemporary 
biological issues (as found in popular press) to increase/update the participants' 
biological content knowledge as well as to begin developing their understanding of 
NOS so they could effectively discern science from non-science. In order to help the 
participants increase their understanding of NOS, a series of interventions were 
planned and incorporated into the PD activities. Knowing that short term PD is not 
enough to affect lasting gains in NOS (Akerson & Morrison, 2006), the NOS 
instruction would be continued during monthly meetings throughout the academic 
year. The participants’ conceptions of seven NOS tenets were measured before and 
after the two-week summer PD to help frame the subsequent NOS instruction. 

Participants 

The participants were public school teachers selected from a pool of applicants 
who responded to an announcement of the workshop that was sent to school 
districts in the surrounding area, or who learned of the workshop by word-of- 
mouth. Their years of teaching experience ranged from two to 19 years and the 
grade levels they taught ranged from kindergarten to twelfth grade. Participants 
were selected based upon their personal needs for PD. Those who were teaching out 
of their subject field or who lacked PD credits were given priority as per the grant 
requirements. Twenty-five middle school and high school teachers were invited to 
participate in the workshop and of those invited, 19 indicated interest in 
participating in this research. Only 11 completed all aspects of the PD including 
signing the consent form to participate in research, completing both weeks of 
instruction, completed both pre- and post-assessments, and meeting for interviews 
before and after the interventions. These 11 participants (the units of analysis) and 
their development of NOS understanding are the focus of this research. Table 1 
includes the participants’ years of experience, content area, grade taught, and 
pathway to certification. 
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Table 1 . Teacher participant demographics 


Participant 

Years of 
Experience 

Educational 

Background 

Grade Taught 

Pathway to 
Certification 

1 

6 years 

B.S. Biology 

9th 

Alternatively 

Certified 

2 

4 years 

B A Home Economics 

6 th 

Alternatively 

Certified 

3 

8 years 

B.S. Educational 

Studies 

8th 

Traditional 

4 

6 years 

M.S. Educational 
Studies 

6 th 

Traditional 

5 

4 years 

B.S. Interdisciplinary 
Studies 

9th 

Alternatively 

Certified 

6 

19 years 

M.S. Earth Science 

4-th 

Alternatively 

Certified 

7 

12 years 

B.S. Interdisciplinary 
Studies 

1 st and Kindergarten 

Alternatively 

Certified 

8 

7 years 

B.S. Movement 

Science 

7 th and 8 th 

Alternatively 

Certified 

9 

2 years 

B.S. Secondary 
Education 

9 th - 12 th 

Traditional 

10 

2 years 

M.S. 

9th 


11 

11 years 

B.A. Interdisciplinary 
Studies 

8th 

Alternatively 

Certified 


METHODS 

All study participants voluntarily consented to be included in the research and all 
participated in each aspect of the professional development activities listed in Table 

2 . 

Participants’ knowledge of NOS was initially assessed using the Views of Nature 
of Science Questionnaire Version D (VNOS-D) (Lederman & Khishfe, 2002). The 
VNOS-D was administered 2 weeks prior to the PD experience. After reviewing the 
participants’ responses to the VNOS-D, individualized interviews were conducted. 
The purpose of the interview was to give the participants opportunities to expand 
on their answers and to respond to semi-structured open-ended questions and 
statements related to particular NOS tenets. The participants were also asked to 
explain their answers and give examples when possible. Individual interviews were 
scheduled and conducted prior to the beginning of the two-week PD. Interviews 
ranged from 25-45 minutes in length, were audio recorded, and transcribed 
verbatim. The transcribed interviews and the VNOS-D responses were used to 
create individual participant profiles that represented each participant’s 
understanding of NOS prior to the PD. 
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Table 2. Formative evaluation of the gene technology modules 


Intervention 

Description 

NOS Tenets 

Contextual (C) 
De-contextual (D) 

Checks activity 
(Crue, 1932) 

Groups collected data from checks and used their 
findings to develop a story. They revised their 
conclusions as they gathered more evidence. Once 
each group had developed their final story, they 
shared it with the rest of the class. When one group 
found flaws in another group's story, its members 
used their data to contradict the story thereby 
adding to the body of knowledge shared by the class. 

T, E, S, C, S&C, 
O&l 

D 

The "15 Myths of Science" 
(McComas, 1997) 

Used to inform participants about how their previous 
science learning may have fostered false 
understandings 

T, E, S, C, S&C, 
T&L 

D 

Paired statements 
(Smith & Scharmann, 

2008) 

Participants were given 10 pairs of statements and 
asked to rate one of each pair as more representative 
of science and the other as less representative of 
science. They were asked to discuss why they choose 
to designate them the way they did. They completed 
the assignment individually and then as small groups. 
After all groups completed the activity, each group's 
answers were compared and discussed. 

T, E, O&l 

D 

Proof wall 

The Proof Wall was an ongoing opportunity to stress 
the importance of the tentativeness of science. To 
help participants replace the word proof (with more 
authentic descriptors like supported by, validated by, 
etc.), a poster was placed on the wall with the word 
Proof on it. Anytime a participant used the word 
proof or a derivation of it (or prove or proven), a 
check mark was placed on the poster. This was 
followed by a short discussion to reiterate the need 
to find a better way to make these statements. 

T 

D 

Footpath murders: DNA 
profiling's landmark case 
(Dowling, 1997) 

This documentary was shown to engage participants 
in the topic of DNA fingerprinting. The video tells the 
story of the first time DNA fingerprinting was used in 
a criminal case to exonerate a charged felon and to 
identify a murderer. To determine if the participants 
could recognize NOS tenets within the context of 
actual scientific research rather than just as an 
abstraction, each participant received a NOS checklist 
and instructed to fill in examples of the seven tenets 
while they watched the film. This was followed by a 
class discussion. 

T, E, S, C, S&C, 
O&l, T&L 

C 

Ulcer wars 
(Mosley, 1994) 

This documentary describes the discovery of the 
bacteria Helicobacter pylori and the subsequent cure 
for ulcers as well as the reticence of the scientific 
community to accept these new discoveries (which 
contradicted previous held scientific belief). A NOS 
checklist was provided to document any evidence of 
NOS tenets while they watched the film. This was 
followed by a class discussion. 

T, E, S, C, S&C, 
O&l, T&L 

C 
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Origin of AIDS 
(CBC, 2004) 


How's your horoscope 
(Flammer, 2002) 


Evolution, creationism, 
intelligent design debate 


This documentary describes a controversial, T, E, S, C, S&C, 

alternative theory of the origin of HIV and AIDS, e.g. O&l, T&L 

HIV was spread through the Congo via a living polio 

vaccine. A NOS checklist was provided to document 

any evidence of NOS tenets while they watched the 

film. Time was given for individual group discussions 

to determine if the controversial Attenuated Polio 

Virus theory (APV theory) seemed scientific or non- 

scientific. This was followed by a class discussion. 

Participants were given a list of twelve personality E, O&l 

profiles and asked to identify which one best 

represented their personality. After participants 

decided which one best matched them, the birth 

dates associated with each profile were revealed. As 

a class, they calculated the percentage of participants 

who accurately identified their moon-sign (matched) 

and compared these findings to chance alone. They 

then discussed and debated the scientific merit of 

astrology. Arguments were based on the seven NOS 

tenets. 


Participants debated with an imaginary school board T, E, S, S&C, 

about what should be included in a science O&l, T&L 

curriculum: evolution, creationism, or intelligent 

design. They were randomly divided into three 

groups and asked to investigate one of the three 

"theories ” They were instructed to act as supporters 

for their particular theory and asked to use the seven 

NOS tenets and associated philosophy of science 

language to argue why their theory should be 

included in the curriculum. After a short 

presentation, school board members were given the 

opportunity to argue against the inclusion of each 

theory in their science curriculum (again using 

philosophy of science language and the seven NOS 

tenets). 


C 


D 


C 


Analyzing Pre-intervention VNOS-D 

The VNOS-D (Lederman and Kishfe, 2002) consists of seven open-ended 
questions that are useful in determining respondents’ conceptions of the seven NOS 
tenets targeted by this study. It includes questions such as ‘What is science?’ and 
‘How do scientists know that dinosaurs really existed?’ Such questions have no 
single right or wrong answer, but rather strive to elucidate respondents’ 
conceptions of the general nature of scientific understanding. The VNOS-D is a user- 
friendly version of the survey that can be administered in a relatively short period of 
time (approximately 30 minutes). 

Evaluating responses to the VNOS-D requires careful interpretation joined with 
individualized interviews. Prior to this study, the first author and two trained VNOS- 
D co-raters established interrater reliability using a distinct set of VNOS-D 
responses. Initially, each co-rater individually evaluated 10 completed surveys. Each 
answer was read independently and unitized by identifying and electronically 
highlighting any phrase that related to any of the seven NOS tenets being studied (a 
different color was used to visually identify each NOS tenet). After evaluating all 
answers, the scorer determined if the respondent’s conception of each tenet was 
informed, transitional, or naive. Co-raters compared their results to reveal a 42% 
interrater match. After discussing the results of the initial trial surveys in depth, 
another set of survey responses were analyzed. After this next step, an 82% 
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interrater match was achieved. The first author then analyzed the eleven survey 
responses used in this study and allowed the co-raters to review his resulting 
scores. Once all data were unitized and color-coded for all seven tenets, pre¬ 
interview participant profiles were created. 

The first author further analyzed the VNOS-D data using the constant 
comparative methodology; codes were created and modified, which were used to 
describe the data units (Patton, 2002). This same methodology was used throughout 
the research when analyzing other data sources (e.g. interview transcriptions) and 
provided triangulation between pre-intervention VNOS-D responses, pre¬ 
intervention interviews, post-intervention VNOS-D responses, and post-intervention 
interviews. By using this approach, the independent analysis of each data source 
was continually compared to previous sources, thus reducing the chance of bias and 
increasing validity of the analysis. 

After coding all VNOS-D data units across all participants, the codes were 
reviewed and revised to accommodate redundancies with the original coding and to 
accommodate distinct differences among them. The first author consulted with the 
VNOS co-raters to assist in this process of code revision. Some codes became more 
inclusive to contain what was previously identified as distinct ideas. In other words, 
multiple codes might be collapsed into one when participants expressed the same 
concept. In other instances, codes were split to accommodate distinct ideas within a 
related area. Once all codes were created, each was classified as informed, 
transitional, or naive (or a combination of these identifiers) based on how closely the 
idea of the code aligned with or contradicted the desired understanding of the NOS 
tenet to which it related. This classification strategy for coding was modified from 
the analysis used in other NOS research (Lederman et al., 2002). 

Pre-intervention interview questionnaire 

The pre-intervention interview served as an opportunity to clarify initial 
perceptions of the participants’ understandings of the seven NOS tenets and added 
validity to the interpretation of their VNOS-D responses. Any ambiguity in the VNOS- 
D responses was addressed at this time. The interviews were transcribed and color- 
coded in the same manner as the VNOS-D responses. Because the interview 
questions were designed in response to the participants’ VNOS-D responses, 
interview data were used to clarify participants’ VNOS-D responses and to increase 
validity in the interpretation of the data. 

Development of pre-intervention profiles 

A pre-intervention profile was developed for all participants from the data 
collected (VNOS-D responses, follow-up interviews) prior to the PD. All data was 
color-coded (as previously described) and assimilated into preexisting codes 
(identified during VNOS-D analysis) or given new code names if needed. After the 
data units were identified in the transcription, each was added to the individual 
participants’ profiles to further depict their conceptions of each NOS tenet. These 
profiles were working documents that included participant-generated data that 
represented their understanding of the seven NOS tenets. For each NOS tenet, the 
researchers categorized the participants’ conception on a continuum from naive to 
informed as described below. 

The resulting overall collection of data units (from the pre-intervention VNOS-D 
responses and interview data units) was then used to evaluate participants’ 
conceptions of each of the seven NOS tenets being studied. Because an individual 
participant’s data regarding a single tenet could include naive, transitional, and 
informed codes, their overall conception could not be categorized so simply; their 
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understandings were more complex than this 3-tiered schema. Instead, the 
collection of all codes found was considered as a set. The participant's overall 
conception was then placed along a 5-tiered continuum and was categorized as: 
informedtransitional/informed[ transitional , transitional/naive, or naive. Table 3 
describes each classification category. 

Table 3. Classification categories used in investigation 


Classification Assigned 
for Each NOS Tenet 

Informed 

Transitional/Informed 


Description of Code 

only informed codes demonstrated an understanding of all aspects of the NOS tenet 

Included mainly informed codes regarding the NOS tenet, but also included at least 
one transitional or naive code 


Transitional Included both informed and naive codes, or only transitional code 

Included mainly naive codes regarding the NOS tenet, but also included at least one 
Transitional/Naive transitional or informed code; the naive codes were not reconciled during the 

follow-up interview 

^ .. only naive codes or provided no data regarding the NOS tenet (including during the 

follow-up interview questions addressing the NOS tenet} 


This strategy classified participants’ conceptions of each NOS tenet and provided 
a baseline for their understandings prior to the intervention. It also allowed for 
consistent ranking across all participants. 

Professional development (PD) as intervention 

The summer portion of the PD took place over two weeks and included 10 days 
(Monday through Friday) of instruction that focused on the initial stages of the 
development of their understanding of NOS. Follow-up monthly academic year 
meetings would reinforce and further develop their NOS conceptions. The 
instruction consisted of nine explicit NOS instructional opportunities, including 
activities and films (Table 2), that ranged from highly contextualized (i.e. creation, 
evolution, intelligent design debate) to highly decontextualized (i.e. footprint 
activity). Many of these activities have been used previously in NOS instruction 
(Flammer, 2002; McComas, 1997; Smith & Scharmann, 2008) while others were 
created by the first author. 

This study employed both decontextualized and contextualized instructional 
strategies to develop NOS understandings among the participants. The intention of 
the PD was to first demonstrate each NOS tenet via a decontextualized instructional 
strategy so as to operationally define the terms and provide a general abstract 
understanding of the tenet. Later, each NOS tenet would be demonstrated via 
contextualized instructional methods (e.g. science films depicting the scientific 
enterprise) to enhance their understandings using concrete examples. 

After each NOS activity, the instructor led a class discussion to give the 
participants an opportunity to discuss how each NOS tenet was exemplified by the 
experience. The novel approach to NOS instruction used in this study was the 
incorporation of instructional documentary films that portrayed historical cases of 
scientific discoveries (CBC, 2004; Dowling, 1997; Mosley, 1994). These full-length 
documentaries were watched during the course of the PD. After viewing each film, 
the instructor initiated an explicit/reflective discussion to explore how each of the 
seven NOS tenets were portrayed (or not portrayed) in the story depicted. 
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Post-intervention VNOS-D and interview 

At the conclusion of the two-week summer PD, the participants were again asked 
to complete the VNOS-D questionnaire. This was another opportunity for the 
participants to articulate their understanding of NOS concepts in relation to the 
VNOS-D questions. As with the pre-intervention questionnaire, some NOS tenets 
were more easily elucidated than others and, as recommended, a post-intervention 
interview was conducted via telephone by the lead author at the conclusion of the 
summer portion of the PD. During the interview, each participant was first asked to 
convey his/her conception of NOS and then asked to describe how their conceptions 
had changed over the course of the two-week PD. They were also asked to share 
their ideas about each of the seven NOS tenets individually. This allowed them 
another opportunity to overtly explain any other thoughts that they may have left 
out of previous data sources. At the end of the interview, the participants were 
asked whether they believed a better understanding of NOS empowered them to 
make decisions about what should and should not be included in a science 
curriculum. All interviews were audio-recorded and transcribed for analysis. 

Development of post-intervention profiles 

The post-intervention profiles were created by integrating the data from the 
post-VNOS-D and the post-interview into the participant’s pre-intervention profile. 
The data from the post-intervention VNOS-D questionnaire and interviews were 
unitized and coded using the same methods as the pre-intervention data. As the data 
units were coded, comparisons were made between the post-intervention units and 
those from the pre-intervention data sources. For example, in the pre-intervention 
data, a participant may have only addressed the tentative nature of science by 
describing how scientific knowledge grows [naive code: New scientific knowledge 
will be added]. In the post-intervention data, she may have referenced how scientific 
knowledge grows, but also described how, with new technology and new 
interpretations, previously held scientific claims could be improved and corrected. 
This post-intervention conception would have been given the informed code [New 
knowledge grows AND is corrected ]. If a contradiction between the pre and post¬ 
intervention data were detected, a new ranking for the participant’s conception of 
the tenet would be assigned to the post-intervention data set. If no contradiction 
were identified, the pre-intervention ranking for the tenet would remain under the 
assumption that the prior conceptions had persisted throughout the interventions. 

RESULTS 

Results by NOS tenet 

The primary goal of the study was to determine how inservice science teachers’ 
NOS conceptions changed after engaging in an explicit PD experience that targeted 
tenets of NOS. Each participant’s VNOS-D questionnaire and interview responses 
were unitized based on NOS tenets and the data units were classified as informed, 
transitional/informed, transitional, transitional/naive or naive based upon their 
agreement with or deviation from the working description of each tenet put forth in 
this research. Each participant’s data units for each NOS tenet were compiled into 
seven groups (one per tenet) to create individual participant’s profiles. Individual 
participants’ results are presented in Table 4. 
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Table 4. Individual participants’ pre- and post- NOS conceptions 
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TI = Transitional Informed 
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Once the individual participant’s NOS tenet profiles were created, a composite 
class profile for each tenet was developed. The composite class profile for each tenet 
was also displayed along the continuum as: informed, transitionai/informed, 
transitional, transitional/naive, or naive. This class profile for each tenet 
demonstrated how the intervention was effective in changing the participants' 
collective conceptions of NOS. Pre- and post-intervention profile results for the 11 
participants across each of the seven NOS tenets are found in Figures 1-7. The 
asterisk aligned to the title of the tenet indicates that there was overall 
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Figure 1. Pre-post intervention conceptions of tentative 
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improvement in the participants’ understanding of that tenet. 

Tentative nature of science*. Most of the participants began the PD with well- 
developed understandings of the tentative nature of science. 

However, some did not convey an understanding that scientific knowledge is 
revised as new evidence is discovered and new technology is developed. Rather, 
they only conveyed that more knowledge would be gained, a common 
misconception. Other participants’ had the misconception that scientific knowledge 
is relatively permanent and not subject to change. One participant demonstrated 
both of these misconceptions in her statement: 

...what we already know is going to be there from now on...but there’s 
gonna be some new knowledge with our capabilities to go farther like 
space, for example...they’re talking on t.v. about living on Mars and 
we're gonna learn new stuff about Mars that we don't know now. 
(Participant 5] 

At the culmination of the PD, all participants demonstrated an understanding of 
this aspect of the tentativeness of science and most were classified as 
transitional/informed or informed for this NOS tenet. One participant, however, 
maintained the misconception that after further exploring a scientific phenomenon, 
the tentativeness is lost and ideas have been proven; this participant was classified 
as naive at the conclusion of the PD. When asked to explain what she meant by 
"proven", she replied: "...prove using experimentations and evaluating. Doing a lot of 
experiments over and over again...Everything is tentative until you explore it further" 
(Participant 7). 

Empirical nature of science*. Participants' conceptions of the empirical nature 
of science varied from naive to informed both before and after the PD. 
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Figure 2. Pre-post intervention conceptions of empirical 
NOS 

However, there was improvement in understanding among some of the teachers. 
Some teachers conveyed the misconception that no empirical evidence was needed 
to ground a scientific claim. This example was coded naive. 

...I do believe that people can move forward with science on a hunch, so 
it doesn’t necessarily have to be grounded in empirical evidence...I 
know there’s some science stuff out there that the evidence isn’t there, 
they still just believe that it should be and they’re still working towards 
that. (Participant 3) 

Many of the participants held the misconception that all scientific claims were 
directly supported by observational evidence and failed to recognize that scientists 
make inferences upon their empirical evidence to come to conclusions. The 
following example, which was coded transitional, demonstrates this notion: "...faith 
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is something you believe, science is something that you can physically test and 
physically experiment on. If it's not there, then it’s not science" (Participant 1). 

At the conclusion of the PD, some of these teachers’ understandings of the 
empirical nature of science had improved, but some naive conceptions persisted. For 
example, when responding to the VNOS-D question regarding confidence in the 
weather forecast made by meteorologists, Participant 7 stated: "Weather people can 
only be as certain as the satellites in space are to show them the weather patterns." 

Subjective nature of science. Participants’ conceptions of the subjective nature 
of science ranged from naive to informed both before and after the PD. 

- - - — - 

Pre- and Post-Conceptions of 
Subjective NOS 



Figure 3. Pre-post intervention conceptions of subjectivity 
of NOS 

Very little improvement in this tenet was detected. Generally, the participants 
failed to note that prior theoretical commitments influence how scientists interpret 
data and draw conclusions. Rather, many conveyed the idea that subjectivity was 
simply the possession of various opinions failing to identify the reason different 
opinions might exist. Two examples demonstrate the general concensus regarding 
this tenet; “...everybody has their own opinion, right?” (Participant 7) and 7 think it’s 
background... I think it's personal experiences” (Participant 9]. 

The overall understanding of the subjective NOS among the participants did not 
change over the course of the PD. 

Creative nature of science*. Participants’ conceptions of the creative nature of 
science ranged from naive to informed at the outset of the PD. Their conceptions 
ranged from transitional/naive to informed at the conclusion. 
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The most common conception of the creative nature of science held by the 
participants was that scientists use creativity only when setting up experiments; 

A scientist must stay detached from the outcome of an investigation, but 
sometimes creativity and imagination help in designing how to 
accurately investigate something. Part of planning maybe, but a scientist 
must remain detached from the results in order to fully understand the 
item being investigated. (Participant 11] 

By the end of the PD, however, this same participant demonstrated the much 
more informed view of this NOS tenet; 

...and then you read science fiction and fantasy and now some of that 
stuff is coming true. Years ago, back in the 60’s, they talked about 
building a little submarine with people in it and injecting it into a 
person's blood and sending it on its way to do the surgery or whatever. 

And now, we can put in little targets for cancer, piggy-back on viruses 
and we can target it! How much different is that? (Participant 11) 

By the end of the PD, most participants described creativity as being important 
for all aspects of the scientific process, but only some were able to describe the role 
it played in inventing explanations for phenomena. 

Social and cultural nature of science. At the outset of the PD, participants’ 
conceptions ranged from naive to informed and very little improvement was 
detected as a result of the PD. 
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Figure 5. Pre-post intervention conceptions of social & 
cultural NOS 

Some participants began the PD with informed views of how social and cultural 
values influence science; 

People are born with problems who are dying from diseases. We're 
looking for ways there because, again, we put value on human life. So 
maybe that gets more research than 'what planet is outside our 
universe?’ There is funding for that, but I think we put our money where 
our heart is as a society. (Participant 8) 

Others possessed naive views that persisted throughout the PD. When asked how 
social and cultural values influenced the direction of scientific research, one 
participant stated; 

Actually, I don’t think so. It might influence the direction we go at the 
time, but I really think science is so universal...I don’t think it would 
have any effect on how we would do [science] or the outcome of 
research...! think science, across the board, is very, speaks the same 
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language in every country, in every language. So, I’d have to say I 
disagree. (Participant 4) 

Observations and inferences of nature of science. Only one participant began 
the PD with a naive/transitional conception regarding the difference between 
observations and inferences. 
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Figure 6. Pre-post intervention conceptions of 
observations & inferences of NOS 

When asked how scientists infer the color and texture of dinosaur skin found on 
replicas in museums, one participant indicated that either they had fossilized 
evidence or they were purely guessing; "The only whay they would know color... they 
would totally have to guess on that. But texture, there have been some...fossilized skin 
surfaces...thatgive them some idea, but again, they’re going to have to grasp at that" 
(Participant 3). 

Others conveyed a much more informed understanding of how scientists use 
available evidence to make inferences about that which they have no direct 
observations. In response to the same question, another participant replied: 
"Scientists can probably get close to what the dinosaurs looked like, again, by looking 
at what we find in the remains and common characteristics of present day living 
organisms" (Participant 5). 

Theories and laws nature of science*. All participants began the PD with either 
naive or transitional/naive conceptions regarding the difference between theories 
and laws. 


Pre- and Post-Conceptions of 
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Figure 7. Pre-post intervention conceptions of 
theories & laws NOS 
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Most held the misconception that theories were tentative while laws were 
unchanging. In reference to the laws of heredity in genetics (as asked in the VNOS-D 
questionnaire), one participant stated; 

...if you cross this with this, this is what you’re gonna get because that’s 
the way it is and if something else happens then you have a problem. If 
anything ever does show up to be the contrary to the evidence and holds 
true, then we have to change the law, or say it’s not a law, it’s a theory. 

But a law is undisputable. (Participant 3) 

Most also believed that there was a hierarchical relationship between 
hypotheses, theories, and laws and that theories could eventually become laws with 
enough confirming evidence; 

Well, you start with a hypothesis. Some question in mind...then you do 
experiments on it and you get enough people looking at it and then you 
go, ‘okay, well we’ve got a theory...And then it happens over and over 
again, to me years, it’s not gonna change...Then you go, okay, well then, 
it’s a law. (Participant 1) 

While no participant achieved an informed conception of theories and laws, most 
began to convey that they understood the difference between each construct and 
stated the difference qualitatively (e.g. hypotheses, theories, and laws are not 
hierarchically related to one another); 

...so now what I'm still trying to get in my head is that the laws are kind 
of like a generality or a pattern of things that happen, but theories try to 
explain why they happen. I was reading that article [McComas, 1997] 
about the hypothesis, the way we use them in school, they are really 
predictions...So maybe I might need a little more help on that one. But 
the big thing is that laws and theories are totally different things. 
(Participant 6) 

Influence of films on NOS gains 

The post-assessment VNOS-D and post-interview questions in no way referred to 
any of the PD interventions as these questions are standardized and validated. The 
VNOS-D questionnaire examines NOS conceptions in context of weather forecasting, 
inferring the physical appearances of dinosaurs as well as the cause of their 
extinction, and general questions about scientific methodology. The post-interview 
questions first probed the participants’ general conceptions of science and NOS, and 
inquired about how these may have changed over the course of the PD, and then 
addressed each NOS tenet explicitly and asked the participants to explain each. 

The post-PD data revealed that the films influenced participants’ NOS 
conceptions and that they used examples from the films to explain many of the NOS 
tenets. This was observed in both their post-VNOS-D questionnaire and post¬ 
interview responses. Six of the eleven participants directly referred to The Origin of 
AIDS to give examples of how they conceived the various NOS tenets. None of the 
participants referred to Ulcer Wars or Footpath Murders: DNA Profiling's Landmark 
Case. Participants used The Origin of AIDS to explain their understanding of five of 
the seven NOS tenets examined in this study: tentative, empirical, subjective, 
creative, and social/cultural. It is important to note that during the post-interview, 
the first author did not elicit probing questions regarding the films, but instead, the 
participants voluntarily referred to the documentaries in their responses. For 
example, when asked to explain if scientific knowledge might change in the future 
(in response to a VNOS-D question about the tentative nature of science), Participant 
#9 replied, 

...yes I do feel that knowledge may change in the future. One example is 
based on the current accepted idea of how AIDS originated in humans 
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(the cut hunter hypothesis). Yet there is another idea that is beginning 
to surface based on the polio vaccine given to millions in Africa and how 
this may be a better explanation for the origin of AIDS. 

Participant #2 referred to how the film demonstrated the necessity of empirical 
evidence to support scientific claims. She referenced how this would be a 
determining factor in what she would teach in her classroom; 

I’m not going to go teach people that AIDS could... that AIDS has come 
from Polio. You know there’s philosophies out there, there's thoughts 
out there, there's hypotheses, there’s research that’s being done and 
there's a lot of interesting data. But what do we know about AIDS 
is...and go through the empirical and canonical knowledge... 

In the post-PD interview, Participant #11 pointed out the subjective NOS by 
referencing how the scientists and reporters in the film had differing theoretical 
commitments to the accepted scientific propositions about AIDS. 

The reporter saw things a certain way and the scientists saw things a 
different way. It’s not that either one was wrong, but they came from it 
from a different perspective and that’s part of what a scientist has to be 
careful of is making sure they are in a detached way. They’re looking at 
things in a detached way and not bringing in their own subjectivity... 

Three participants noted how the film portrayed the creative NOS. In response to 
the VNOS-D question regarding creativity, Participant #1 referred to the Origin of 
AIDS in saying, "Scientists use creativity to explain occurrences that are not explained 
well or have questions about the explanations - HIV stemming from Polio.” Participant 
#7 felt the scientists in the film were “...very creative in what they were using to fight 
the Polio.” 

Participant #9 leaned heavily on The Origin of AIDS to describe creativity among 
both scientists and non-scientists. 

Tom Curtis and Ed Hooper [journalists] both observed the data from the 
polio vaccine in Africa and the fact that they began to wonder if there 
was a connection between the administering of the vaccine and the 
original outbreak of AIDS was highly creative. Also, thinking of how to 
go about researching and putting together this information was creative, 
especially with Bill Hamilton [scientist] and his idea to study the blood 
and feces of the chimpanzees in that area. I feel that the majority of the 
creativity comes in the observations and creation of the 
experiment/research. 

With regards to the social and cultural NOS, Participant #7 referenced the claim 
from the Origin of AIDS that in the race to discover the cure for Polio, scientists 
discounted the rights of test subjects who were from marginalized populations. "So 
it brings you back again to they didn’t think much of the African people. 'Oh just use 
them as guinea pigs and if they die, they die.’ Kind of like when they brought African 
people to the United States.” 

Participant #4 referred to how reading an article about developing countries 
triggered memories of The Origin of AIDS and reminded her of the social and cultural 
differences in Africa allowed science to progress differently than in the U.S.: 

It [the article] talked about as much as 66% of the population is living in 
conditions I couldn’t even begin to understand and it brought back 
looking at the videos. When we saw that video, in that hospital, and the 
primitive conditions, and that’s in my lifetime... And the way they’re 
doing things, and even their culture makes them go at it a certain way, 
that I hadn’t considered because it's something I don’t even know. 

Clearly, seeing the reality of life in a third world country allowed this participant 
to think about the science behind vaccinations in a very different way. 
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Films were not referenced to describe participants’ conceptions of the roles of 
observations and inferences or the distinction between theories and laws. Five of 
the participants made no reference to the films in either their post-VNOS-D or in 
their post-interviews. 

DISCUSSION 

Despite being considered a critical aspect of scientific literacy (NGSS Lead States, 
2013), many teachers and students fail to develop informed conceptions of NOS or 
recognize its importance in the development of scientific literacy (Sahin & Koksal, 
2010). Much research has been done regarding the best practices to educate 
students about NOS and many studies have called for the implementation of 
conceptual change interventions (Abd-El-Khalick & Akerson, 2004, 2006; Ozgelun, 
2012; Schwartz, Lederman, & Crawford, 2004) to assist in this understanding. To 
this end, this study implemented the use of documentary films in conjunction with 
decontextualized NOS activities to encourage conceptual change regarding NOS 
aspects among inservice science teachers. Based upon the results from this study, it 
appears that combining contextualized and decontextualized NOS activities in a PD 
experience can affect change among the teachers’ views of NOS. In particular, it 
appears that teaching NOS tenets through viewing contextualizing-films and 
subsequent discussions about those films provided participants the opportunity to 
support their developing conceptions. The overall gains across participants’ NOS 
understandings were observed in four of the seven NOS tenets. 

Of the participants with less than informed views of the tentative NOS, 55% 
demonstrated improved understandings by the end of the PD. In addition, 70% 
demonstrated improved understandings of the empirical NOS, 89% demonstrated 
improved understandings of the creative NOS, and 72% demonstrated improved 
understandings of the distinction between theories and laws. Although each activity 
within the PD experience had direct, explicit instruction of all tenets of NOS, it 
appears that these four tenets showed the most change in accordance to the pre¬ 
post VNOS-D questionnaire and the follow-up interviews. 

By contrast to these changes, less positive growth was detected when compared 
with the other three tenets (e.g. subjective, social and cultural, and the distinction 
between observation and inferences) being analyzed in this research. Among 
participants who began with less than informed views of the subjective tenet of NOS, 
20% demonstrated improvement in their understanding. In relation to the socially 
and culturally embedded tenet of NOS, 11% of those beginning with less than 
informed views appeared to have developed an improved understanding. Finally, 
those participants beginning with less than informed understanding of the 
distinction between observations and inferences, 18% demonstrated improvement. 

It should be noted that while improvement toward informed views of NOS was 
detected among several participants across multiple tenets of NOS, the 
improvements observed did not consistently translate into informed views. At the 
conclusion of the PD, participants achieving an informed view of NOS were observed 
in only three tenets of NOS being investigated: creativity, tentative, and empirical. A 
question arises as to why this phenomena was observed, e.g. what activities 
occurred during the PD promoted change toward informed views of NOS in three 
tenets instead of all seven tenets? What can account for this trend? 

The activities addressed during the PD experience (see Table 2), were drawn 
from an array of classic NOS activities, e.g. check activity (Crue, 1932) and the 
McComas (1997) article, The 15 Myths of Science, taught in many NOS classes and PD 
workshops. Other activities were created by the PD providers (e.g. Proof Wall and 
Creation/Evolution/ID Debate). Each of these classic and novel NOS activities 
targeted one or more of the seven NOS tenets being researched and provided the 
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common experience among the teacher participants to participate in a discussion of 
them in a decontextualized fashion. Research has indicated that incorporating 
instruction that has a mix of the decontextualized and contextualized approaches 
appears to be an effective strategy for improving NOS understandings (Abd-El- 
Khalick, 2001; Brickhouse et al., 2000; Clough, 2006) and this study aligns with this 
prior research. However, this study adds a new twist into the array of classic NOS 
activities as it introduced documentary films that highly contextualize NOS. 

What separated this PD experience from other NOS PD opportunities is the 
unique feature of viewing documentary films from the perspective of NOS and the 
reflective discussion that followed the viewing of each film. The documentaries 
presented in the PD were: (1) Footpath Murders: DNA Profiling’s Landmark Case 
(Dowling, 1997), (2) Ulcer Wars (Mosley, 1994), and (3) The Origin of AIDS (CBC, 
2004). These documentaries, shown in in their entirety, gave the participants a 
visual description of what NOS would look like in an authentic scientific setting and 
allowed them to think about each NOS aspect in a contextualized way. 

Egan (1997) contends that the role of storytelling provides vivid images that 
create an "affective charge" (p.62) that shapes the learners' emotional commitment 
to the content, in this case, NOS. Research has suggested that modern day 
storytelling in the use of films can be an effective vehicle for teaching content, 
including science (Dubeck, Moshier, & Boss, 1988; Dubeck, Moshier, Bruce, & Boss, 
1993; Koehler et al., 2013). In addition, it was suggested that the effects of television 
programs on students’ understanding of NOS indicated that students were more 
likely to accept scientific conclusions as absolute (not tentative) when presented in 
documentary format (Dhingra, 2003). 

The post-intervention data indicates that the use of films may have been 
influential in the positive gains among the participants with regards to their NOS 
conceptions. While all three films strived to contextualize science with emotionally 
stirring imagery, not all were equally successful in their attempts. For example, Ulcer 
Wars is a 50-minute documentary about the discovery of Helicobacter pylori as the 
cause of stomach ulcers; among the three films shown, it is arguably the most 
textbook in its delivery. It offers some narrative into the thoughts of the scientist 
conducting the research and the challenges he faced by the scientific community in 
his efforts, but there is scant drama to the film. 

Footpath Murders: DNA Profiling’s Landmark Case is a 24-minute documentary of 
the discovery of DNA fingerprinting technology and its subsequent use to convict a 
criminal of murder. It offers more drama with some recreated murder scenes, 
authentic video footage of witness interrogation, and interviews with key both 
scientists and law enforcement agents who worked to solve the double murder 
investigation. However, the film is quite dated and the recreated scenes in no way 
compare to what is seen on crime scene shows every night on popular television 
networks (e.g. NCIS, CSI). 

The Origin of AIDS, however, is qualitatively different. This film was relatively 
new (less than five years since production), is a full length, 91-minute documentary. 
It provides much more drama than the other two films and is filled with graphic 
images of vivisection of chimpanzees and other primates, multiple interviews with 
scientists from around the globe promoting and contesting a proposed alternative 
explanation of HIVs emergence (via oral polio vaccines), and has an emotion- 
inducing background classical music score. Origin of AIDS was created for the 
purpose of engaging the audience and convincing the viewers to consider an 
alternative explanation of AIDS origins as opposed to the accepted scientific 
explanation (the Cut Hunter explanation). 

While all three films were used to contextualize the scientific process (Clough, 
2006) and targeted all seven NOS tenets, participants only referred to Origin of AIDS 
to justify their answers regarding NOS. We feel it is the nature of the Origin of AIDS 


© 2015 iSER, InternationalJ. Sci. Env. Ed., 10(3), 405-428 


423 



M. Bloom, I. C. Birins & C. Koehler 


in contrast to the other two documentaries that explains this fact. While all three did 
a good job of demonstrating scientific methodology and conveying scientific 
knowledge, only the Origin of AIDS was designed to be an emotion-triggering, 
dramatic story. This quality provided the vivid imagery as Egan (1997) contends 
that is necessary to influence learners. As such, this made the Origin of AIDS the most 
effective film to transform the participants’ views of NOS. 

The results revealed that six of the 11 participants referenced The Origin of Aids 
to explain their conceptions of one or more of the NOS tenets targeted by this PD 
intervention. One participant explained how the Origin of Aids portrayed the 
tentative NOS by exposing the uncertainty of medical science as the film portrayed 
novel treatments for the disease as well as the negative outcomes of some 
individuals that were depicted in the film. Another participant used this film to 
describe the empirical NOS as the criteria that she would use to rule out presenting 
the APV theory of HIV. One participant described how the strong theoretical 
commitment exhibited by the research scientists in the film demonstrated the 
subjective NOS well. Two participants were reminded of the social and cultural NOS 
by the film as it depicted how the scientific endeavor portrayed in the African Congo 
so greatly contrasted to that in developed, Western countries. Three participants 
provided examples from the film to describe their conception of the creative NOS by 
describing how scientists use creativity in three distinct ways: to develop new 
explanations of natural phenomena, to develop new technology (medical), and to 
identify unexpected consequences of scientific progress. 

The fact that these six participants all referred to this one film without any 
prompt or solicitation from the researcher suggests that contextualizing NOS in 
dramatic, story-telling films, can prove effective in impacting learners metacognition 
about NOS. Knowing this adds to the growing body of knowledge that inform PD 
providers about the benefit of contextualizing NOS instruction using documentary 
films. 

IMPLICATIONS 

This research promotes the notion of contextualized NOS instruction utilizing 
films. The short nature of the PD does not inform the long-term effectiveness of this 
teaching strategy, but does provide evidence on how the use of films can affect 
change in inservice teachers’ conceptions of core NOS tenets. This early change in 
understanding NOS sets the stage for follow-up PD to reinforce and further develop 
more informed NOS understanding (Akerson & Morrison, 2006). Further research is 
currently investigating the effectiveness of other types of films, including Hollywood 
box office hits, for teaching NOS, scientific inquiry, and the dispositions of scientists 
(Koehler et al., 2013). Specifically, contextualized, scenario-based, activities are 
currently being employed to determine how this form of NOS instruction can 
improve preservice teachers’ argumentation skills regarding scientific issues. Early 
research into the use of mainstream films for NOS instruction is promising; further 
research can determine if such a strategy can have long-term effectiveness in 
promoting NOS understanding for the students of the 21 st century. 
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